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ABSTRACT 



A method and apparatus for automatically and adap- 
tively generating tonescale transformation functions 
that are robust with respect to imaging systems, expo- 
sure conditions, and body parts. The technique uses the 
histogram of the digital input image, the cumulative 
distribution function of the histogram, and the entropy 
of subsections of the histogram to create the final tones- 
cale transformation. Using these three functions, the 
histogram can be divided into a region of interest, a 
low-signal foreground region, and a high-signal back- 
ground region. The tonescale is constructed to be sub- 
stantially linear over the region of interest, joining 
smoothly with a nonlinear portion extending from the 
end of the low-signal foreground region to the start of 
the region of interest, and another nonlinear portion of 
the high-signal background region. The substantially 
linear region of interest and the entire image are subject 
to certain output density constraints to optimize the 
diagnostic utility of the final image. The technique de- 
pends entirely on the histogram of the input image, and, 
hence, it is adaptive and robust. 



22 Claims, 12 Drawing Sheets 
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METHOD AND APPARATUS FOR AUTOMATIC 
TONESCALE GENERATION IN DIGITAL 
RADIOGRAPHIC IMAGES 

TECHNICAL FIELD OF THE INVENTION 

The present invention relates to digital image pro- 
cessing, and more particularly to a method and appara- 
tus for automatically adjusting the tonescale of a digital 
radiographic image. 

BACKGROUND OF THE INVENTION 

When any digital image is displayed on some output 
medium (e.g., film or a CRT monitor), its image quality 
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tal domain. This A/D conversion function, also known 
as the input calibration function, is generally a mono- 
tonic nonincreasing or nondecreasing* function. It as- 
signs to each value of the physical variable a gray level 
in the digital image. Thus, the output tonescale. which 
maps these input gray levels to output gray levels for a 
display device, is essentially a mapping of the values of 
the input physical variable into output luminance on a 
display (e.g. a CRT or Film on a viewbox). At the same 
time, small differences in gray level in the digital image 
are related to small differences in the value of the physi- 
cal variable (through the derivative of the input calibra- 
tion function). Thus, the shape (specifically, the local 
slope) of the output tonescale also determines the visual 



depends on a number of important factors, such as the 15 contrast of small differences in the input physical vari 
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characteristics of the device used to acquire the original 
data, the capabilities of the output device (dynamic 
range, noise characteristics, sharpness, etc.), and the 
image processing that has been performed on the image 
prior to display. In particular, the image processing tone 
reproduction function (i.e., the tonescale or gradation 
curve) used to map the digital values of the image into 
viewable shades of gray is a key component in produc- 
ing a useful output image. 

In the case of diagnostic radiology, for example, the 25 
tonescale used for display of images of various body 
parts has a significant impact on the ability of the image 
interpreter (i.e., the radiologist or physician) to extract 
useful diagnostic information from the image. In con- 
ventional (analog) screen/film radiography, this output 30 
tonescale is generally already designed into the film by 
the film manufacturer, and a variety of different films is 
available to get different looks' depending on exam 
types, exposing techniques, and observer preferences. 
The ability in digital radiography systems to adjust this 35 
output tonescale in the computer before the final image 
is displayed is one of the most powerful features of such 
systems. However, choosing or creating the appropri- 
ate tonescale is not always a simple operation because it 
depends, among other things, on the above mentioned 
factors (exam type, exposure conditions, imaging mo- 
dality, dynamic range of the output device, etc.). 

Ideally each digital image should have its own tones- 
cale function in order to be displayed optimally. This is 



able. 

Two commonly used forms of input calibration func- 
tion are linear and logarithmic transformations, al- 
though there are also variety of other nonlinear trans- 
formations. In the linear transformation, the digital gray 
levels are lineally related to values of the input physical 
variable: 

where the m/are the input gray levels, x is the physical 
variable being measured, and a and £ are constants. In 
the case of logarithmic conversion, the input gray levels 
vary logarithmically with the input physical variable: 

m/»cr*log(jf+y)+8 

where m/ and x are as above and cr, y, and 8 are con- 
stants. Tonescale mapping functions designed for loga- 
rithmically acquired input images will produce subopti- 
mal results when applied to linearly acquired images 
and vice versa. This is because the human visual system 
will perceive a different visual contrast of various struc- 
tures in the output image depending on whether small 
differences in gray level are linearly or logarithmically 
related to small differences in the physical variable 
being displayed. Thus, in order to be adaptive and ro- 
bust, a tonescale generation method must be able to 
caletunction in oraer to De aispiayea optimally, imsis ce w , . whh different of 

^usetheac^dist^ 45 £ functions> 

, e., the image histogram) is different for each image. ^ ^ ^ tQ ^ tQnes . 

Usually, however, there are some general similarities 
within certain classes of images (e.g., for a given x-ray 

acquisition device and set of exposure conditions, all - . - - 

~\ , ,. , ... . r , t , histogram equalization (see, for example, castleman, 

adult chest radiographs will probably share some com- 50 " B . _ M „ . \ » 

mon characteristics) that make the tonescale generation 

process somewhat easier. The tonescale transformation 

that produces an image of high diagnostic quality must 

ensure, among other things, good contrast in the region 

of interest, reasonable contrast in the remainder of the 55 

image, no clipping (i.e. saturation) of useful anatomical 
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cale curves for digital images, and especially digital 
radiographic images. One common technique is called 



detail at the ends of the gray level range, and no arti- 
facts. 

An additional complication in generating an optimum 
output tonescale for a given digital image, already men- 
tioned briefly above, is that this tonescale depends criti- 
cally on how the image was acquired. The creation of a 
digital image requires an analog to digital (A/D) con- 
version process in which the values of the continuously 



Digital Image Processing). In this technique, an attempt 
is made to transform the input image into an output 
image that has a uniform (i.e., flat) histogram over the 
entire output gray level range, the idea being that this 
output image makes maximal use of the available gray 
levels, and has, according to information theory, maxi- 
mum information. In most cases, histogram equalization 
is a fairly severe transformation. Highly populated re- 
gions of the input histogram are spread over a wider 
60 range of gray levels on output, which increases their 
visual contrast and is usually desirable, if not overdone. 
However, sparsely populated regions of the histogram 
(usually the extremes) are compressed into a smaller 
gray level range, which decreases visual contrast and 



varying physical variable being measured (for example, 65 can obscure important diagnostic details. In addition, 
x-ray transmittance or attenuation, proton density, or . the presence of nonuniform foreground and back- 
radioactivity) are transformed (quantized) into the set of ground regions in an image (e.g., collimator blades, 
discrete gray levels that represent the image in the digi- direct x-ray transmission outside the patient) can cause 
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this technique to waste valuable output gray levels on order to produce a smooth final output. While this 

diagnostically unimportant regions of the image. method is fairly robust with respect to histogram shape 

Other techniques, instead of using , locally, adaptive , and varying amounts of extraneous background, it does . 

transformations as above, have used gross statistical not adapt well to differences in input calibration func- 

features (variance, skewness, percentiles, etc.) of the 5 tion, and thus will produce suboptimal tonescales for 

input histogram in order to calculate the tonescale. This other than linear A/D conversions, 

approach does not always produce acceptable contrast There is presently a need for an automatic method 

and can also produce unwanted clipping at the ends of and apparatus for generating tonescale transformation 

the gray level range. European Patent Application functions that are robust with respect to image-to-image 

EP283255 teaches such a technique in which operator 10 variations, imaging modalities, exposure conditions and 

intervention is needed to set the initial tonescale param- input calibration functions, 
eters for a series of similar images to get a reasonable 

contrast and to avoid clipping, after which the tones- SUMMARY OF THE INVENTION 

cales are calculated automatically based on the mean The object of this invention is to provide a method 
and variance of each input histogram. 15^ a pp ara tus for automatically and adaptively generat- 

Another method has been disclosed in U.S Pat. No. mg optimum tonesC ale transformations for digital radio- 

4,302,672 m which an optimal tonescale transformation hic im based on ^ is of the ^ hist0 . 

is derived for a PA (postero-antenor) or AP (antero- Anoiher object of this invenlion u l0 provide a 

posterior) chest radiograph generated on a storage method and a tus for tonesca j e generation that is 

phosphor acqu.sitton system (with a logarithms input 20 robust ^ tQ variations . £ ^ 

calibration function). This patent teaches that by identj- ^ exposure conditions, and the form of Uie input 

^ge histogram the spine, heart and ^^f^ton Ooga rithmic or linear). 

Zl ?^»?tV appr ° P T ™T 10 The method of the invention is carried out in two 

each in the output tonescale, an unproved output image „ . i - * ^ » * r^* ■ 

can be gotten. The lung region gets the highest contract, 25 ™ Jor st ^ s * ^"t the histogram and Cumulative Distn- 

the heart a somewhat lower contrast, and the spine gets but ! on F " nct f ,on (CDF > are ""J* 2 * t0 determine a 

the lowest contrast. While this approach may work for ' e ? !0n . of in } crcst c <* n *™ n S the anatomical object 

certain kinds of chest images, it may fail in chests where * cm * a ^Sround region containing highly 

it is not possible to identify the three structures cor- absorbing materials (e.g., collimator blades, 

rectly (e.g., in cases where the lungs are fluid-filled and 30 P rostheses )> ™ d * background region containing direct 

have comparable density to the heart or spine). Further- ^nsmission outside the object being imaged. This 

more, a similar analysis of other exam types with the histogram/CDF analysis is done in both the linear and 

appropriate anatomical landmarks would need to be logarithmic domains and the final parameters are se- 

done so that the method could work for all diagnostic lected bv a set of decisi0n ™1« that recombine the 

applications. In addition, this method is not robust with 35 information from the two spaces. The second step is the 

respect to other input calibration functions, since the construction of the tonescale which is done initially as a 

appropriate contrasts for spine, heart and lungs will be of connected line segments using the parameters 

different depending on the A/D conversion technique. derived in the first step, along with some local and 

As an alternative to this approach, U.S. Pat. No. global constraints on the average output signal level and 

4,641,267 teaches a method, again for computed radiog- 40 the out P ut contrast. After the initial rough tonescale is 

raphy, that is based on the use of only a few reference constructed, it is adaptively smoothed to create the final 

tonescale functions. In order to generate the actual tonescale. 

tonescale for a particular input image, one of the refer- method as outlined depends entirely on the histo- 

ence tonescales is selected (depending on the body part) S?*™ of the input image and is therefore adaptive and 

and this function is shifted and rotated by varying 45 robust. However, an improvement on the method also 

amounts depending on the exposure and other parame- makes use of information about the exam type being 

ters of the image. While this method avoids generating processed to produce a tonescale that is even better 

and storing a large number of tonescales for varying customized for a given input image, 

conditions a priori, it W is not completely automatic BRIEF DESCRIPTION OF THE DRAWINGS 
and adaptive, since only shifting and rotating of a fixed 50 

set of predetermined curves is allowed, (b) is not robust FIG. 1 shows a histogram of a typical projection 

with respect to different digital imaging modalities or X-ray image which was acquired with a log input cali- 

input calibration functions. bration function; 

Another method has been proposed in U.S. Pat. No. FIG. 2 is a graph showing the cumulative distribution 

5,046,118 (Ajewole and Schaetzing) that uses some 55 function of the digital image represented by the histo- 

local adaptivity and some global constraints to produce gram in FIG. 1; 

a custom tonescale for each input image. This method FIG. 3 shows a histogram of a typical projection 

uses the entropy of subsets of the complete image to X-ray image which was acquired with a linear input 

divide the image into a region of interest (containing calibration function; 

anatomical information) and a background region, and 60 FIG. 4 is a graph showing the cumulative distribution 

then constructs separate tonescales for each of these function of the digital image represented by the histo- 

regions based on global luminance and contrast con- gram in FIG. 3; 

straints. The tonescale in the region of interest is sub- FIG. 5 is a graph illustrating a typical tonescale trans- 

stantially linear (assuming a linear input calibration formation function generated according to the present 

function), while the tonescale in the background region 65 invention for the region of interest (left point to right 

is nonlinear in order to reduce the contrast of unimpor- point); 

tant parts of the image. The two partial tonescales are FIG. 6 is a graph useful in describing the linear seg- 

subject to certain matching criteria at their boundary in ments of a typical tonescale transformation that are 
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generated according to the present invention from left 
point to background point; 

l FIGr 7 is' a^graph'Urusirating* a ' typical smoothed * * ' 
tonescale transformation function with a roll-off of the 
left point generated according to the present invention 5 
for an input calibration function that is linear; 

FIG. 8 is a graph illustrating a typical tonescale trans- 
formation function that was transformed from the func- 
tion in FIG. 7 for an input calibration function that is 
logarithmic; 10 

FIG. 9 is a graph useful in describing a cumulative 
distribution function slope change calculation; 

FIG. 10 is a graph illustrating a roll-under tonescale 
curve and the resulting modified tonescale curve; 

FIG. 11 is a graph useful in describing the modifica- IS 
tion of the background point due to the slope change 
from the region of interest (ROI) to the remainder of 
the tonescale curve; and 

FIG. 12 is a partially perspective, partially block 
diagram of a digital image processing system including 20 
an embodiment of the present invention. 

MODES OF CARRYING OUT THE INVENTION 

This invention, being a method and apparatus to gen- 
erate optimum output tonescales for digital images, 25 
requires a source of digital images, output devices on 
which to display them, means for processing the image 
data, and communications means to move image data 
from the source to the processing means to the output 
means. Such a digital image processing system is illus- 30 
trated in FIG. 12. The x-ray images to be processed 
with this invention can come, for example, from storage 
phosphor (computed radiography) systems, film digi- 
tizer systems, image intensifier systems, etc. Either lin- 
ear or logarithmic input calibration functions can be 35 
accommodated. In addition, one can use images ac- 
quired on computed tomography systems. For output 
devices, typically there are film writers (either laser 
printers or CRT printers) and CRT 50ft displays. The 
processing means can contain the method and apparatus 40 
for carrying out the invention. 

FIG. 12 shows a storage phosphor digital radio- 
graphic imaging system including an embodiment of the 
present invention. As shown, storage phosphor 10 is 
moved in a substantially horizontal direction 11 by 45 
means of roller pairs 12, 14 and 16, 18 past a scanning 
and emitting region 20. A laser 22 produces a laser beam 
24 which is scanned across the width of storage phos- 
phor 10 in a scanning line direction by means of rotating 
polygon mirror 26, scan optic elements 28 and 30 and 50 
mirror 32. Scan optic elements 28 and 30 shape the laser 
beam 24 to a desired size and shape and correct for F0 
distortion as the beam is scanned across phosphor 10. 
Laser 10 may, for example, be a gas laser or a diode 
laser which produces a stimulating beam in the red light 55 
region. 

Light emitted by storage phosphor 10 (e.g. light in 
the blue light region) is detected by photodetector 34 
and converted to a digital image by analog-to-digital 
converter 36. According to the present invention, the 60 
digital image is subjected to automatic tone scale pro- 
cessing and other image processing in image processing 
apparatus 38 which may, for example, be a digital com- 
puter (microprocessor). The digital image is displayed 
on display monitor 40 and can be reproduced as hard 65 
copy (such as radiographic film) by film writer 42 (such 
as a radiographic laser printer, cathode ray tube mul- 
tiformat camera thermal printer. The digital image can 
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also be stored in magnetic optical or solid state storage 
devices or transmitted to a remote location by a com- 
munication link: The tone* scale processing by apparatus 
38 can be embodied in a look-up table (LUT) which is 
passed with the original digital to display 40 or film 
writer 42. Alternatively, the tone scale processed digital 
image can be transmitted. 

Alternatively, the apparatus of the invention can 
reside in a variety of other places on the system. For 
example, it can be a part of the acquisition device. In 
this case, the disclosed method would generate a tones- 
cale transformation that would be passed to the output 
device, either with the image to be processed, or sepa- 
rately over the communications channel. The method 
could also be a part of the output device. Since the 
tonescale generation method assumes a known, fixed 
output calibration function for the output device (i.e., a 
known relationship between the gray level sent to the 
device and the signal produced on the output medium), 
h may be necessary to do one more transformation of 
the tonescale to achieve the desired visual result when 
the digital image is finally displayed. 

Given an input digital image, the method of the in- 
vention proceeds as follows. The histogram and Cumu- 
lative Distribution Function (CDF) must first be com- 
puted for both linear and log space. See FIGS. 1-4. If 
the image was acquired with a linear input calibration 
function, this linear histogram must also be transformed 
into an equivalent logarithmic histogram (and its corre- 
sponding CDF) in order for the analysis to proceed. 
Conversely, if the image was acquired with a logarith- 
mic input calibration function, this logarithmic histo- 
gram must also be transformed into an equivalent linear 
histogram (and its corresponding CDF). This gives two 
histograms and two CDFs that will be used in the deter- 
mination of parameters for the tonescale. 

The transformation from a linear to a logarithmic 
histogram is straightforward. The gray levels in the 
logarithmic space are related to the gray levels in the 
linear space through the following equation: 

mXlog)=o-*Iog(mXlin)-f-y)+6 (I) 
where m ; <log) and m,<lin) are corresponding gray levels 
in the logarithmic and linear spaces, and <r, y, and 67 
are constants chosen to satisfy certain boundary condi- 
tions (e.g., the end points of the gray value range in 
linear space are mapped to the end points of the gray 
level range in logarithmic space). The mapping from a 
histogram originally in logarithmic space to one in lin- 
ear space is equally straightforward 

mXlin)= i&fiUfrt-rVi+B (2) 
where jx, \, and 0 are again constants that satisfy the 
desired boundary conditions of the mapping. 

The reason for using a histogram in linear space and 
one in logarithmic space has to do with the structure of 
peaks in the histogram in the two spaces and the nature 
of the tests that will be done to find the starting, ending, 
and break points that determine the shape of the tones- 
cale. This will be described in more detail below. In 
addition, the use of two spaces to do the analysis makes 
the method essentially independent of which type of 
system was used to acquire the image. 

The basic concept behind the tonescales generated 
using this method is that the optimum tonescale for a 
linearly acquired image (ie., one created on a device 
with a linear input calibration function relating x-ray 
exposure to gray level) is one in which the x-ray expo- 
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sure values are mapped linearly into optical density background point is set at the beginning of the peak for 
over the region of interest, and rolled ofT nonlinearly later use in the calculation of right point, 
^outside the region ofinterest, that is, in the foreground^ - * Next, the left 'point is calculated using the- CDF of-*- 
and background regions. This observation has been each of the histograms. This is done using the fact that 
made based on thousands of clinical images (primarily 5 a significant peak in a histogram (such as would be 
acquired on storage phosphor systems) gathered in created by the region of interest) results in a major slope 
clinical studies over several years. This argument would change in the CDF (see FIG. 9). By using ratios of 
also imply that images acquired on logarithmic systems averaged slope changes in the histogram, as will be 
(systems where the input calibration function relating described, it is possible to find the beginning of the 
x-ray exposure to gray level is loganthmic) would have io region of interest . Specifically, in the gray level region 
an optimum tonescale that is exponential over the re- froni q^oo, a window size of 100 is used to calculate 
gion ol interest, and nonlinear in the foreground and ^ chan Fof ^ , eve , 

, two CDF slopes are 

background regions. This has been found to be the case t nx °'r*r\t? ,i a :„ inn ™„ 

in clinical studies where such logarithmic devices have wTi£ ^ ? ^ ° ^ ™ 

been used levels above the current gray level is computed. The 

Having established the qualitative shape of the tones- " *? mc ^ one for * e l °° ! eveh M °Z 

cale needed to display linear or logarithmic images, it thc c . urrcnt ™ e Cm where thecalculation would 

remains to find a robust way to determine the parame- f^S* ** y * low CDF "f "J™? t0 

ters that will generate such a transformation. The first * 0) " ™ c ratl ° of »>0pcs of the gray levels above 
step in finding the parameters of the tonescale is to find 20 e ^ eaX t0 , th l° ncS Wow the current one is 
the histograms start and end points. The start and end stored m m m * In ^ S rav levcl ran 8 c 100-200, the 
points (see FIGS. 1 and 3) are the first and last gray same calculation is done except that a varying window 
levels in the histogram, respectively, whose histogram size 18 used - starting at 100 for gray level 100 and in- 
values are non-zero. All of the pixels in the image are creasing to 200 at gray level 200. Between gray level 
contained between these limits. A set of start and end 2 5 200 and (background point - 200), the same calculation 
point is found for both the logarithmic and linear histo- is done with a window of 200. The array of slope 
grams. change values is then scanned to find the maximum 

In order to separate the histogram into foreground, a slope change in the region where the CDF<0.5 (or 
region of interest, and background, at least two delimit- 50%), and this is defined as the left point. This calcula- 
ing points must be found: one that designates the bound- 30 tion is done for both the linear and logarithmic CDFs. 
ary between the foreground and region of interest, Normally the linear portion of the tonescale would 
which will be called the left point (see FIGS. 2 and 4), start at the left point, but it is possible that the region 
and one that designates the end of the region of interest between the start point and the left point contains some 
and beginning of the background, which will be called anatomical details. Thus it is necessary to determine 
the right point (see FIGS. 1-4). In practice, a distinction 35 whether or not to roll off the tonescale curve to accom- 
must be made between real anatomy that is beyond the modate this area. This is done by looking at the magni- 
region of interest (technically in the background) and tude of the maximum slope change (used to find left 
direct x-ray transmission around the part being imaged point) and at which gray level it occurs. As the left 
(which is truly background), so a third point, called the point gets closer to 0, clearly the amount of roll off must 
background point (see FIGS. 1^), is also calculated ^ decrease. Similarly, as the magnitude of the maximum 
that represents the beginning of the true direct x-ray s i 0 pe change decreases, the more likely it is that there is 
background. In summary, three gray level points (in some anatomy in this region (this is because a high slope 
addition to the start and end points) are needed to deter- change implies a rapidly rising peak in the histogram 
mine the form of the tonescale: md a we u delimited region of interest, while a low 

45 slope change implies a gradual rise, perhaps with some 
anatomical detail). In this case, the roll oft is increased, 
sometimes all the way to the start point of the histo- 
gram. 

In order to calculate the right point of the histogram 
50 (the end of the region of interest, and also the end of the 
linear portion of the tonescale for the case of a linear 
input calibration function), two methods are used. One 
of these is the partial entropy technique disclosed in 
The determination of these points will be described in U.S. Pat. No. 5,046,1 18 (Ajewole and Schaetzing), and 
detail below. The derivation will assume that low gray 55 the other is a CDF slope change method similar to that 
levels correspond to low x-ray signals and high gray used in finding the left point The partial entropy 
levels correspond to high x-ray signals, but this is not method produces an effective width of the region of 
necessary for the invention. The analysis below can be interest (ROI) by analyzing the structure of the histo- 
straightforwardly modified for the inverse situation. gram between left point and initial end point. The right 
In constructing the tonescale, it is first necessary to 60 point (see FIGS. 1 and 3) with this method is given by 
find the background point A method for doing this has the sum of the left point and the effective width. The 
been shown in U.S. Pat. No. 5,046,118 (Ajewole and same entropy calculation is done on the logarithmic 
Schaetzing), which uses the concept of partial entropy histogram to produce a second right point estimate, 
to divide the histogram into a background region and a This logarithmic estimate can be mapped back into the 
non-background region (foreground + region of inter- 65 linear space for the analysis to be described below, 
est). The background point (see FIGS. 1 and 3) is found The CDF method when applied to the linear and 
for both the linear and logarithmic histograms. If the logarithmic histograms produces two other estimates of 
background point is found at the top of a peak, an initial the right point (see FIGS. 2 and 4). In this method, the 
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CDF slope change ratio is found for each gray level 
(see FIG. 9), just as it was for the left point calculation, 
f using a winfro w~of 200* and * starting ' at the * gray level 
where the CDF has reached 0.5 (or 50%). Thus, for 
each gray level, the average CDF slope of the follow- 
ing 200 gray levels is found, after which the average 
slope of the 200 preceding gray levels is found. The 
ratio of the 'following slope* to the 'preceding slope* is 
stored in an array. This process continues until the gray 
level within two window widths (i.e., 400) of the initial 
background point has been reached. The gray level 
where the minimum slope change ratio occurs is desig- 
nated the right point. 
The above steps have produced four estimates of the 



10 



10 



FIG. 5). The tone scale in this region is linear for a 
linear input calibration function. The initial tonescale in 
the ROI is a straight 'line gbmg 'from r (left"pomt, L 0Xto '- 
(right point, median), where median is initially set, for 
example, to 1.7 for a laser printer, and the notation (x,y) 
denotes the abscissa and ordinate in a graph of output 
density as a function of gray level. The average density 
contributed by pixels in the gray level range from left 
point to right point is computed as the sum of the values 
of the tonescale at each gray level multiplied by the 
percentage of pixels at that gray level (i*e., the histo- 
gram value normalized to represent a probability), 
summed from left point to right point. Depending on 
the exam type being processed, the ROI has a set of 



right point. Generally, these estimates will not all be the 15 experimentally determined aim densities that will opti- 
same, and some decision mechanism must select an mize the display of the image. For example, the opti- 
optimum right point for tonescale construction. The mum range for a chest is D =0.77-0.83, while for an 
decision mechanism uses a set of closeness criteria in abdomen it is D=0.83-0.90, and for an extremity it is 
comparing the various right point estimates, with pref- D= 1.03-1.09. If the average density of the ROI is 
erence usually being given to the estimates generated by 20 lower than the aim, the median value is increased until 



the CDF method. Clinical experience with both meth- 
ods has shown that the CDF method usually gives a 
somewhat better prediction of the correct right point, 
but this is not always the case. 

In the case of extremity exams, only two of the four 25 
estimates, those from the entropy method, are used. The 
histograms of extremity exams are different in that the 
CDFs tend to be more linear (for linear input acquisi- 
tion functions); that is, the incremental percentage of 



it is within range. If the average density is higher than 
the aim, the median value is lowered until it is in range. 

The tonescale region from the right point to the back- 
ground point (see FIG. 6) is constructed as a series of 
line segments the end point coordinates of which de- 
pend on the local structure of the CDF, and some local 
and global constraints. In particular, if the slope of the 
consecutive line segments decreases as the background 
point is approached, there is a constraint on the amount 



pixels added to the CDF per gray level does not vary as 30 that the slope is allowed to change from segment to 



much as with other exams. This is because of the rela- 
tively high x-ray transmittance of tjie (thinner) soft 
tissues in extremities, which results in the gray levels of 
the soft tissues being closer to the gray levels represent- 
ing the background. The criterion for choosing the 35 
correct right point in extremity exams is the percentage 
of pixels added to the CDF per gray level in the input. 
If this number is greater than or equal to 0.0075%, the 
higher of the two right point estimates is chosen as the 



segment. This so-called gain decrement depends both 
on the total change in the CDF value between the right 
point and the background point and on the distance 
between the right point and the average gray level 
value between right point and the background point. 
The former quantity indicates roughly how many pixels 
are outside the region of interest, while the latter quan- 
tity indicates something about how they are distributed. 
The bigger the CDF change or the larger the distance 



right point. If the percentage of pixels per gray level is 40 between the right point and the average gray level, the 



less than 0.0075%, then the lower of the two estimates 
is used as the right point. 

Once the left point, right point, initial background 
point, and background point have been chosen, a final 
refinement of the initial background point is made, 
again using the maximum slope change method. Start- 
ing at right point, for each gray level, the average CDF 
slope of the following 200 gray levels (see FIG. 9) and 
the average slope of the preceding 200 gray levels are 



larger will be the slope change allowed between seg- 
ments. 

Two types of tonescale behavior are possible in the 
region between right point and background point. If the 
45 slope of a line from (right point, median) to (back- 
ground point, Dmox) is larger than the tonescale slope in 
the ROI, the tonescale curve is classified as a roll-under 
curve (see FIG. 10). In this case, the tonescale curve is 
constructed so that the slope in the range from right 



computed, and their ratio is found and stored in a mem- 50 point to background point is the same as that of the 



ory array. The gray level at which the slope change is 
maximum becomes the initial background point to be 
used in later calculations (see FIGS. 2 and 4). 

In what follows, the ordinate values of the tonescale 
will be expressed in terms of aim optical densities as- 55 
suming a hardcopy output medium. If the output me- 
dium is a CRT display, the ordinate scaling can be done 
similarly using the logarithm of luminance ratios. For 
example, if L mflJC is the maximum luminance of the dis- 
play, then an equivalent density at some other lumi- 
nance, L, can be defined as D^= — log(L/L max ). Nor- 
mally the range of densities for a CRT display is far less 
than that Of the hardcopy, but the resulting range can 
be rescaled to fit the hardcopy range so that the aim 
densities used below can be easily translated into equiv- 
alent luminances on the CRT. 

The tonescale construction starts in the interval from 
left point to right point, i.e., in the region of interest (see 



60 



65 



region of interest. In addition, the tonescale curve is 
extended with this slope until the histogram end point is 
reached. In other words, the line segment representing 
the ROI is simply extended to the right until it hits the 
histogram end point. 

If the slope from (right point, median) to (background 
point, Umax) is less than that of the region of interest 
(FIG. 6), then the tonescale is classified as a roll-over 
curve, and multiple line segments will be used to con- 
nect to the background point If the slope in the ROI is 
higher than the slope between (right point, median) and 
(background point, Dmax) by more than the maximum 
gain decrement calculated above, the background point 
is moved closer to the right point until this change is 
equal to the maximum gain decrement (see FIG. 11). 
The region between right point and background point is 
then filled in with a set of line segments, each starting 
where the previous one ended, with slopes less than or 
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equal to the segment before. The actual length and slope 
of each segment depend on the percentage increase in 
the CDF (starting at the last ordinate) for. fixed* percent- 
age increases in the remaining gray levels between the 
current gray level and background point. Thus, the 
shape of the tonescale at higher output densities de- 
pends on the number and distribution of pixels in the 
histogram in this range, but not as directly as it does in 
the histogram equalization technique. The fixed per- 
centage increase in gray level used to control the seg- 
ment slopes is different for different exams. It is 20% for 
chests and 25% for other exams. Each newly con- 
structed segment is temporarily extrapolated towards 
maximum gray level to check if it hits D mfl jr before or 
after the background point. If it hits D majt before reach- 
ing the background point, another segment is added to 
the tonescale. If it does not hit D mflJ before background 
point, the current segment is altered to reach D ma x at 
the background point and the tonescale construction in 
this region is finished. From the background point to 
the end point, the tonescale is constant at D max 

After construction of the tonescale, an average den- 
sity criterion for the entire image (left point to initial 
background point) must also be satisfied. If the average 
density of the image is too high the median point is 
lowered, and the line segment are recalculated until it is 
within the aim density range. If the average density is 
too low, the median point is increased until it is within 
the aim density range, The average densities for the 
entire image are in the range D= 0.87-0.90 for chests, 
D=0.93-0.96 for abdomens, and D = 1.12-1.15 for ex- 
tremities. 

For abdomen and extremity exams, an extra set of 
calculations must be done. It has been found experimen- 
tally that starting the tonescale at (left point, D m ,>) for 
these exams has the effect of making the highly calcified 
regions in bones in extremities and the denser regions of 
abdomen exams (especially the subdiaphragmatic re- 
gion) too white in the output. As a result, the tonescales 
for these exams are made to start at (left point, D mz/7 +- 
0-1). This requires calculating a new effective left point 
by extrapolating the ROI line through this new point 
until it hits D mi >,. From this new left point a new tones- 
cale is calculated in the ROI, between right point and 45 
background point, and out to end point using the same 
methods described above. In addition, the window for 
rolling off the tonescale at left point (if this is being 
done) must be changed to accommodate the new left 
point 5 q 

Before the construction of the final tonescale, the 
roll-off of the left point is done (see FIG. 7) in order to 
not clip any anatomical details that might reside be- 
tween start point and the final left point This roll-off 
operation is done using a moving average window, the 55 
size of which was calculated above. 

The final operation is to smooth the tonescale (see 
FIG. 7) in order to eliminate any slope discontinuities in 
the region of the tonescale containing the line segments. 
It is important to note that the smoothing operation is a 60 
selective operation applied only to the tonescale regions 
that need it. The ROI is not smoothed at all, so it re- 
mains linear for a linear input calibration function. A 
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ously decreasing window size is used until the maxi- 
mum gray level is reached. 

.--ir-the.-input calibration function- is linear,, thereon- > 
struction of the tonescale is complete. It the input cali- 
bration function is logarithmic, the entire tonescale 
must be transformed using the logarithmic-to-linear 
conversion function (Eq. 1) calculated above (see FIG. 
8). 

Industrial Applicability 

The invention has application in digital imaging sys- 
tems such as in medical diagnostic digital imaging sys- 
tems. 

What is claimed is: 

1. A method for generating a tonescale transforma- 
tion for digital radiographic images comprising the 
steps of: 

providing a digital radiographic image; 
in a digital computer: 

generating both linear and logarithmic histograms 

from said digital radiographic image; 
forming a linear cumulative distribution function 

(CDF) from said linear histogram; 
forming a logarithmic CDF from said logarithmic 

histogram; 

determining start and end points for each of said 
linear and logarithmic histograms, respectively, 
where said start and end points are the first and last 
gray levels whose histogram values are non zero; 

determining for each of said linear and logarithmic 
histograms, respective left points which delineate 
the border between foreground and region of inter- 
est, right points which delineate the border be- 
tween the region of interest and remaining anat- 
omy and background points which delineate the 
border between remaining anatomy and true direct 
x-ray background; 

constructing a tonescale function, 

(a) having a linear portion from the left point to the 
right point in the region of interest, computing the 
average density in the region of interest, and de- 
pending upon a classification of the radiographic 
image, raising or lowering the median value until it 
is in a predetermined optimum range for the digital 
radiographic image classification; 

(b) having one or more line segments from^the right 
point to the background point, wherein the end 
point coordinates of the line segment(s) are deter- 
mined by the local structure of the linear CDF; 

(c) having a roll off between the start point and left 
point using a moving average window; and 

(d) raising or lowering the average density of the 
entire tonescale depending upon a predetermined 
average density for a classification of the radio- 
graphic image; 

and either processing the digital radiographic image 
with the tonescale function to produce a processed 
radiographic image, or creating a look-up table 
containing the tonescale function and transmitting 
the look-up table with the digital radiographic 
image. 

2. The method of claim 1 wherein said step of deter- 
mining the left point for each of said linear and logarith- 
mic histograms is calculated by using the CDF of each 



window size approximately one tenth the number of 

available gray levels is used, starting a half a window 65 of the histograms or each gray level from 0 to a prede- 
size below the right point and proceeding to half a termined gray level, calculating the ratio of the slopes 
window size away from the maximum gray level. Be- of the gray levels of a predefined number of gray levels 
tween this point and the maximum gray level, a continu- above the current one to a predefined number of gray 
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levels below the current one and defining the left point logarithmic histogram determined by the CDF slope 
as the gray level having the maximum slope change in ratio technique and the right point of the logarithmic 
' ttie'region below said' ^re'determined gray' level. * : histogram 1 determined bythe'partial entropy 'technique** 

3. The method of claim 2 wherein said slope ratio is back into linear space to produce four estimates of the 
determined as follows: 5 right point and then selecting an optimum right point 

(a) in the gray level region from 0-n, a window size of for tone scale construction using a set of closeness crite- 
n is used to calculate slope changes so that for each ria in comparing the various right point estimates, 
gray level, two CDF slopes are computed such 9. The method of claim 5 wherein said provided digi- 
that the average CDF slope in the n gray levels tal radiograph image is a image of an anatomical ex- 
above the current gray level is computed, the aver- 10 tremity of a human and wherein the correct right point 
age CDF slope for the n gray levels below the is chosen by determining the percentage of pixels added 
current gray level is computed and the ratio of the to the respective CDF per gray level in the input, and if 
slopes of the gray levels above the current one to this number is greater than or equal to 0.0075%, the 
the gray levels below the current one is stored in a higher of the two right point estimates is chosen as the 
memory; 15 correct right point and if the percentage of pixels per 

(b) in the gray level range n-2n, the same calculation gray level is less than 0.0075%, then the lower of the 
is done except that a varying window size is used two right point estimates is used. 

starting at n at gray level n and increasing to 2n at 10. The method of claim 1 wherein said background 
gray level 2n; point is an initial estimate and a final refinement of the 

(c) between gTay level 2n and background point-2n, 20 background point is made using the maximum slope 
the same calculation is done with a fixed window change technique such that starting at the right point 
of 2n; and for each gray level, the average CDF slope of the fol- 

(d) the slope change values stored in memory are lowing x gray levels and the average slope of the pro- 
scanned to find the maximum slope change in the ceeding x gray levels are computed and their ratio 
region where the CDF is less than 0.5 and this gray 25 found and stored in a memory and choosing the gray 
level is defined as the left point. level in which the slope change is maximum as the final 

4. The method of claim 2 wherein roIl-ofT of the background point for the tone scale function, 
tonescale curve from the start point to the left point is 11. The method of claim 1 wherein the step of con- 
determined by looking at the magnitude of the maxi- structing a tonescale function in the linear portion from 
mum slope change used to find the left point and as the 30 the left point to the right point is effected as a graph of 
left point gets closer to 0, decreasing the amount of output density as a function of gray level and the initial 
roll-off, and as the magnitude of the maximum slope tonescale is a straight line going from left point 0 to 
change decreases, increasing the roll-off. right point median where median is initially set to a 

5. The method of claim 1 wherein the right points of value of 1.7, and including average density contributed 
said linear and logarithmic histograms are determined 35 by pixels in the gray level range from left point to right 
using a partial entropy technique wherein an effective point as the sum of the values of the tonescale at each 
width of the region of interest is determined by analyz- gray level multiplied by the percentage of pixels at that 
ing the structure of the respective histogram and the gray level summed from left to right point, wherein said 
right point is determined by the sum of the left point and predetermined optimum range for the digital radio- 
the effective width. 40 graphic image classification is a density value for a 

6. The method of claim 1 wherein said right point of digital radiographic image of an anatomical part of a 
said linear and logarithmic histograms is determined human and said median value of said linear portion of 
using the CDF of each histogram such that a CDF slope said tonescale function is raised or lowered until it is in 
change ratio is found for each gray level starting at the a predetermined optical density range for a specified 
gray level where the respective CDF has reached 0.5 45 anatomical part. 

and using a window of 2n gray levels such that for each 12. The method of claim 11 wherein the optical den- 
gray level, the average CDF slope of the following 2n sity range for a chest is D=0.77-0.83. 
gray levels is found and the average slope of the 2n 13. The method of claim 11 wherein the optimum 
preceding gray levels is found and the ratio of the fol- density range for an abdomen is D=0.83-0.90. 
lowing slope to the preceding slope is stored in mem- 50 14. The method of claim 11 wherein the optimum 
ory, continuing to find the ratio for each gray level density range for an extremity is D= 1.03-1.09. 
within two window widths of the initial background 15. The method of claim 1 wherein said step of con- 
point and determining the gray level where the maxi- structing a tonescale function between said right point 
mum slope change ratio occurs as the right point. and said background point, includes determining 

7. The method of claim 6 wherein said digital image 55 whether the slope of a line from the right point to the 
is a 12 bit image and wherein said window is set at 200 background point is larger than the slope from the left 
so that the ratio for each gray level is determined by point to the right point, and if it is, then the tonescale 
taking the average CDF slope of the following 200 gray curve is classified as a roll-under curve and the tones- 
levels over the average slope of the 200 preceding gray cale curve from the right point to the background point 
levels. 60 is constructed so that the slope is the same as that in the 

8. The method of claim 6, including the further step region of interest, that is the line segment representing 
of finding the right points of said linear and said lbga- the region of interest is extended to the right until it hits 
rithmic histogram by means of a partial entropy tech- the background point gray level. 

nique which produces an effective width of the region 16. The method of claim 1 wherein the step of con- 
of interest by analyzing the structure of the histogram 65 structing a tonescale function between said right point 
and the respective right point is determined by the sum and said background point includes determining 
. of the left point and the effective width, and further whether the slope from the right point to the back- 
including the step of mapping the right point of the ground point is less than that of the region of interest 
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and, if it is, the tonescale is classified as a roll-over curve 
and multiple line segments are used to connect the back- 
ground , point. , * t. ; \ vii y r. . ■- f . y - - - > V.- - ^ . i. 

17. The method of claim 16 wherein said line seg- 
ments are determined as follows. If the slope in the 5 
region of interest is higher than the slope between the 
right point and background point by more than a maxi- 
mum gain decrement, the background point is moved 
closer to the right point until this change is equal to the 
maximum gain decrement and the region between right 10 
point and background point is Tilled in with a set of line 
segments, each starting where the previous one ended 
with slopes less than or equal to the segment before 
with the actual length and slope of each segment de- 
pending on the percentage increase in the CDF for 13 
fixed percentage increases in the remaining gray levels 
between the current gray level and the background 
point. 

18. The method of claim 17 wherein the fixed per- 
centage increase in gray levels used to control the seg- 20 
ment slopes is set as 20% for a digital radiographic 
image of a human chest and at 25% for a digital radio- 
graphic image of other human anatomical parts. 

19. The method of claim 18 wherein each newly 
constructed line segment is temporarily extrapolated 25 
towards a maximum gray level to see if it hits the maxi- 
mum density before or after the background point and if 

it hits maximum density before reaching the back- 
ground point, another line segment is added to the 
tonescale, and if it does not reach the maximum density 30 
before the background point, the current line segment is 



,993 

altered to reach the maximum density at the back- 
ground point and the tonescale construction in this 
region is terminated so that the. tonescale Js constant at . 
maximum density from the background point to the end 
point. 

20. The method of claim 1 wherein the step of con- 
structing a tonescale function to raise or lower the aver- 
age density of the entire tonescale is dependent upon a 
predetermined average density of a digital radiographic 
image of a human anatomical part such that the prede- 
termined density range for a chest radiographic image is 
D =0.57-0.90, the predetermined density range for an 
abdomen radiographic image is D= 0.93-0.96, and the 
predetermined density range for an extremity radio- 
graphic image is D = 1.12-1.15. 

21. The method of claim 1 wherein said method of 
constructing a tonescale is smoothed to eliminate any 
slope discontinuities in the region of the tonescale con- 
taining line segments, by using a window size approxi- 
mately one-tenth the number of available gray levels, 
starting at a half a window size below the right point 
and proceeding to half a window size away from the 
maximum gray level and between this point and the 
maximum gray level, a continuously decreasing win- 
dow size is used until the maximum gray level is 
reached. 

22. The method of claim 1 wherein if the input cali- 
bration tonescale function is logarithmic, the linear 
tonescale function is transformed into log space using a 

logarithmic to linear conversion function. 

♦ * * * * 
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